Dialog prediction for a general model of turn-taking
نویسندگان
چکیده
Today there are solutions for some specific turn-taking problems, but no general model. We show how turn-taking can be reduced to two more general problems, prediction and selection. We also discuss the value of predicting not only future speech/silence but also prosodic features, thereby handing not only turn-taking but “turn-shaping”. To illustrate how such predictions can be made, we trained a neural network predictor. This was adequate to support some specific turn-taking decisions and was modestly accurate overall.
منابع مشابه
Flexible Turn-Taking for Spoken Dialog Systems
Even as progress in speech technologies and task and dialog modeling has allowed the development of advanced spoken dialog systems, the low-level interaction behavior of those systems remains often rigid and inefficient. The goal of this thesis, is to provide a framework and models to endow spoken dialog systems with robust and flexible turn-taking abilities. To this end, we designed a new dial...
متن کاملMultiparty Turn Taking in Situated Dialog: Study, Lessons, and Directions
We report on an empirical study of a multiparty turn-taking model for physically situated spoken dialog systems. We present subjective and objective performance measures that show how the model, supported with a basic set of sensory competencies and turn-taking policies, can enable interactions with multiple participants in a collaborative task setting. The analysis brings to the fore several p...
متن کاملA Finite-State Turn-Taking Model for Spoken Dialog Systems
This paper introduces the Finite-State TurnTaking Machine (FSTTM), a new model to control the turn-taking behavior of conversational agents. Based on a non-deterministic finite-state machine, the FSTTM uses a cost matrix and decision theoretic principles to select a turn-taking action at any time. We show how the model can be applied to the problem of end-of-turn detection. Evaluation results o...
متن کاملTurn-Taking Estimation Model Based on Joint Embedding of Lexical and Prosodic Contents
A natural conversation involves rapid exchanges of turns while talking. Taking turns at appropriate timing or intervals is a requisite feature for a dialog system as a conversation partner. This paper proposes a model that estimates the timing of turn-taking during verbal interactions. Unlike previous studies, our proposed model does not rely on a silence region between sentences since a dialog...
متن کاملTowards a Neurocognitive Model of Turntaking in Multimodal Dialog
Communicating individuals take turns speaking, gesturing, and interacting according to their goals and circumstances. The process is referred to as turn taking and it is a major organizing mechanism in real-time dialog. Thorough psychological studies have shown there to be a significant amount of similarity between societies with regard to observed behaviors during conversation (O’Connell et al...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010